robot exclusion protocol造句

As Monier pointed out, " You don't want the thing to index itself, " so Web sites can use something called the Robots Exclusion Protocol to tell web crawlers what to skip.
I tried using the http : / / www . archive . org Wayback machine on http : / / www . nationmaster . com / encyclopedia / Chuquet but nationmaster uses a robot exclusion protocol and is not indexed by Wayback . ( talk ) ] ] 09 : 33, 2 Sep 2004 ( UTC)
The "'robots exclusion standard "', also known as the "'robots exclusion protocol "'or simply "'robots . txt "', is a standard used by websites to communicate with web crawlers and other email harvesters, spambots, malware, and robots that scan for security vulnerabilities may even start with the portions of the website where they have been told to stay out.
I tried using the http : / / www . archive . org Wayback machine on http : / / www . nationmaster . com / encyclopedia / Chuquet but nationmaster uses a robot exclusion protocol and is not indexed by Wayback . ( talk ) ] ] 09 : 30, 2 Sep 2004 ( UTC ) P . S . Googling on the exact phrase " Around 1550 it seems that a Mr Pelletier introduced a second system " is a way to turn up many currently extant copies of the article as cited by Munafo.
It's difficult to find robot exclusion protocol in a sentence. 用robot exclusion protocol造句挺难的